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Abstract 

Background: Anxiety, depressive and substance use disorders account for three quarters of the disability attributed 
to mental disorders and frequently co-occur. While programs for the prevention and reduction of symptoms 
associated with (i) substance use and (ii) mental health disorders exist, research is yet to determine if a combined 
approach is more effective. This paper describes the study protocol of a cluster randomised controlled trial to 
evaluate the effectiveness of the CLIMATE Schools Combined intervention, a universal approach to preventing 
substance use and mental health problems among adolescents. 

Methods/design: Participants will consist of approximately 8400 students aged 13 to 14-years-old from 84 
secondary schools in New South Wales, Western Australia and Queensland, Australia. The schools will be cluster 
randomised to one of four groups; (i) CLIMATE Schools Combined intervention; (ii) CLIMATE Schools - Substance Use; 
(ill) CLIMATE Schools - Mental Health, or (iv) Control (Health and Physical Education as usual). 
The primary outcomes of the trial will be the uptake and harmful use of alcohol and other drugs, mental health 
symptomatology and anxiety, depression and substance use knowledge. Secondary outcomes include substance 
use related harms, self-efficacy to resist peer pressure, general disability, and truancy. The link between personality 
and substance use will also be examined. 

Discussion: Compared to students who receive the universal CLIMATE Schools - Substance Use, or CLIMATE 
Schools - Mental Health or the Control condition (who received usual Health and Physical Education), we expect 
students who receive the CLIMATE Schools Combined intervention to show greater delays to the initiation of 
substance use, reductions in substance use and mental health symptoms, and increased substance use and mental 
health knowledge. 

Trial registration: This trial is registered with the Australian and New Zealand Clinical Trials registry, 
ACTRNl 261 3000723785. 

Keywords: Prevention, School, Internet, Universal, Randomised controlled trial, IVlental health. Depression, Anxiety, 
Substance use 
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Background 

Substance use, anxiety and depressive disorders account 
for three quarters of the disabihty attributed to mental 
disorders [1]. The peak of this disability occurs in those 
aged 15-24 years old and corresponds with the typical 
period of onset of these problems. Furthermore, sub- 
stance use, anxiety and depressive disorders frequently 
co-occur, share common risk factors and interact [2]. To 
reduce the occurrence and cost of such disorders, it is 
imperative that preventative interventions begin early, 
before patterns of anxiety, depressive and substance use 
symptoms are established and begin to cause disability, 
as well as vocational, educational and social harm [3-5]. 

An array of substance use prevention programs have 
existed for some time [6-11]. However, the majority of 
programs have shown minimal effects in reducing sub- 
stance use and related harms [12-14], and some have 
even reported detrimental effects [15]. It has been sug- 
gested that the most common factors which interfere with 
effectiveness are; the focus on abstinence-based outcomes 
[16,17], and implementation failure [18-20]. 

Problems with the implementation and dissemination 
of drug prevention programs are well-recognised in the 
drug prevention field [18,21-26]. First, programs with 
proven efficacy are often not widely used [27]. Botvin & 
Griffin [27] propose that this is due to the lack of compati- 
bility of evidence-based programs designed by researchers 
with school curriculums. As such, schools often opt for 
commercial programs that are appealing, yet lack support- 
ing scientific evidence. In addition, schools often do not 
have sufficient motivation or resources to adequately train 
educators to teach such program [7,28]. Specifically, a US 
study found only 17 per cent of schools reported training 
teachers in substance use prevention programs [28]. This 
is problematic as teachers may adapt or remove essential 
program components and inadvertently detract from 
the effectiveness of the program [29]. Drug prevention 
programs with the most success in increasing alcohol 
and other drug related knowledge, decreasing pro-drug 
attitudes and decreasing drug use behaviour, are those 
containing harm-minimisation goals and interactive deliv- 
ery techniques, which are correctly implemented [30-34]. 
For example, a meta-analysis by Tobler et al. [35] found 
schools in the United States that implemented both the 
content and delivery methods of the prevention programs 
had the largest effect sizes. Nevertheless, a study con- 
ducted by Ennett et al. [19] found only 14 per cent of 
schools implemented both the content and delivery 
methods of drug prevention programs [35]. 

The effectiveness of prevention programs for anxiety 
and depressive symptoms is also contentious. For example, 
'targeted' prevention programs for young people at high 
risk of a depressive disorder, have been shown to be ef- 
fective over the long term, while universal school-based 



programs for the prevention of depression in young 
people have not consistently demonstrated positive effects 
[36-38]. Here, it has been found that whilst some universal 
prevention programs are effective for reducing symptoms 
in the short term, there is currently no evidence for long 
term effects [36] . 

Programs to prevent and reduce anxiety symptoms 
have also yielded mixed results. A targeted intervention, 
comparing a 10 session cognitive-behavioural therapy 
(CBT) intervention with a waitlist control among 128 
(out of 1,786 screened) highly anxious 14 year olds, 
found the CBT group had half the risk of meeting criteria 
for an anxiety disorder compared to the control group 
(20% vs. 39%) at two-years follow up [39]. An adaption of 
this CBT intervention into a school-based 'universal' pre- 
vention program, called FRIENDS, appears to be the only 
school based prevention program that is effective for both 
anxiety and depression [40]. However, the reliance of 
this program on input from trained professionals, such 
as clinical psychologists and school counsellors, makes 
the program difficult and costly to implement as part of 
routine practice within schools. 

The results of a randomised controlled trial (RCT) of 
a 'targeted' version of the FRIENDS program, delivered 
by trained school staff, as opposed to clinicians, were 
disappointing in that the intervention group showed no 
gains [41]. The majority of schools also failed to continue 
implementing the program after the four year trial. These 
findings underscore the need for more innovative school- 
based programs that are less time and resource intensive, 
as well as less reliant on outside monitoring and sup- 
port for compliance and implementation [38]. Other 
prevention programs aimed at preventing and reducing 
anxiety and depressive symptoms among adolescents 
include MoodGYM and the Aussie Optimism Program 
[42,43]. Trials of the Aussie Optimism Program have 
yielded mixed effects in anxiety and depressive symp- 
toms [43]. In contrast, the MoodGYM (YouthMood) 
program yielded significant differences in anxiety symp- 
toms in adolescents up to 17 years old, however the 
benefits for depressive symptoms were less strong [42]. 
Importantly, only MoodGYM delivers their course on- 
line, thereby supporting the feasibility of Internet-based 
delivery [38]. 

Taken together, the aforementioned programs show 
promising results and highlight the importance of imple- 
mentation fidelity for the development of more effective 
programs to prevent and reduce substance use and symp- 
toms of anxiety and depression. Another key point is that 
current programs are designed to target either substance 
use or mental health disorders, despite research indicating 
that these disorders co-occur [2]. As such, a combined 
approach to prevent and reduce symptoms associated with 
these common disorders may result in greater symptom 
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reduction, be more cost effective and feasible compared to 
separate mental health and substance use interventions. 

The current study seeks to evaluate an innovative com- 
bined approach to prevent and decrease substance use 
and mental health symptoms in Australian adolescents. 
The proposed universal program, known as the CLIMATE 
Schools Combined (CSC) program, will combine the uni- 
versal CLIMATE Schools - Substance Use program and the 
universal CLIMATE Schools - Mental Health program. 
This program will utOise Internet-based delivery in schools, 
which has been identified as an effective method to address 
implementation issues [38,44] 

The CLIMATE Schools Combined (CSC) program 

The CLIMATE Schools Combined program consists of 
both the CLIMATE Schools - Substance Use program 
and the CLIMATE Schools - Mental Health program. All 
CLIMATE Schools programs include both computer-based 
and manualised classroom activities. The computer-based 
component is completed individually via the Internet, 
where students are engaged through contemporary car- 
toon storylines that impart information about substance 
use, and anxiety and depressive symptoms. Students are 
provided with confidential login details to access the 
CLIMATE Schools website. The classroom activities are 
delivered by the teacher and aim to reinforce the learning 
outcomes outlined in the cartoons and allow interactive 
communication between students. Teachers are provided 
with access to all program materials including an outline 
of activities, implementation guidelines, links to the 
education syllabus and summaries for each lesson. Im- 
plementation issues are also addressed, as the program 
is designed to link with the Australian National Cur- 
riculum and Australian state-based Health and Physical 
Education syllabuses. The program is also facilitated by 
the Internet to maximise efficient, complete and con- 
sistent delivery, as well as ensure high implementation 
fidelity. 

The universal CUMATE Schools - Substance Use program 

The universal CLIMATE Schools - Substance Use program 
aims to reduce the use of alcohol and cannabis, Australia's 
most commonly used licit (excluding caffeine) and illicit 
drugs [45]. The program is designed for students aged 
13-14 years old, when significant exposure to alcohol 
and drug use occurs. The program is based on the 
harm-minimisation approach to prevention, as there is 
a growing body of evidence to suggest that this ap- 
proach may be more effective than the abstinence only 
approach [44,46]. 

The CLIMATE Schools - Substance Use program consists 
of twelve 40-minute lessons. The first six lessons focus 
specifically on alcohol and are delivered approximately six 



months prior to the remaining six lessons, which focus on 
cannabis. 

The efficacy of the CLIMATE Schools - Substance Use 
program has been established using a cluster RCT in 10 
schools in Sydney, Australia (n = 764) [47,48]. Results of 
the trial demonstrated that students in the intervention 
group made significant improvements in alcohol and 
cannabis knowledge at the end of the program and at 6 
and 12 months post-intervention, in comparison to the 
control group (where students received drug education 
as usual). The intervention group also showed a reduc- 
tion in frequency of cannabis use at the 6-month follow- 
up, a reduction in average weekly alcohol consumption 
at the 6 and 12 month follow-up, and a reduction in 
frequency of drinking to excess 12 months following the 
intervention. In addition, students participating in the 
CLIMATE Schools program, exhibited high follow-up 
rates, thereby suggesting that the Internet is an effective 
method of delivery. Importantly, students and teachers 
rated the program as acceptable and enjoyable. Specific- 
ally, 100% of teachers who implemented this program in 
their classroom rated it as superior to other substance 
use prevention programs, and over 90% of students re- 
ported information delivered in this format was easy to 
learn and would like more school subjects to be taught 
using this method. 

The universal CUMATE Schools - Mental Health program 

The universal CLIMATE Schools - Mental Health pro- 
gram aims to prevent and reduce anxiety and depressive 
symptoms in young people. The program is designed 
for adolescents aged 14-15 years old, as research dem- 
onstrates that programs are effective in reducing these 
symptoms when delivered at this time [37,38]. This pro- 
gram is based on cognitive-behavioural principles and 
incorporates skill acquisition; psycho education, man- 
agement of psychological symptoms, cognitive symp- 
toms, behaviour and additional skills specific to anxiety 
and depression. There are six 40-minute lessons, which 
are also curriculum-based. 

Updating the CUMATE Schools - Mental Health program 

The CLIMATE Schools- Mental Health program is cur- 
rently being updated and is based on two modules from 
the online school education program provided by the 
'This Way Up' clinic, titled 'Overcoming Anxiety' and 
'Combating Depression'. Originally six lessons each, the 
two modules have been condensed into the six lesson 
CLIMATE Schools - Mental Health program, in order to 
reduce content overlap and decrease time demands for 
participating schools. In revising the program, an experi- 
enced clinical psychologist amended the script of the on- 
line cartoon component, and illustrations were updated to 
reflect current youth trends and to maintain consistency 
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with the CLIMATE Schools - Substance Use program. 
Focus groups were conducted with approximately 30 stu- 
dents from two independent schools in Sydney, Australia 
to ensure that the modifications accurately reflected realis- 
tic scenarios and language of Year 9 students. Once the 
CLIMATE Schools - Mental Health program has been 
modified, a number of health and educational profes- 
sionals will be approached to comment on the program's 
clinical and educational validity, and content will be re- 
vised accordingly. 

Objectives of the CSC study 

The primary objective of the CSC Study is to evaluate 
an innovative Internet-based prevention program for 
the prevention and reduction of substance use, anxiety 
and depressive symptoms, by combining the universal 
CLIMATE Schools - Substance Use program and the 
CLIMATE Schools - Mental Health program. 

It is hypothesised that the CSC program will be more 
effective than; (1) school-based Health and Physical 
Education as usual, (2) the CLIMATE Schools - Substance 
Use program, and (3) the CLIMATE Schools - Mental 
Health program in relation to the following outcomes: 

1) reducing the use and harmful use of alcohol and 
cannabis 

2) reducing overall levels of anxiety and depression 

3) increasing knowledge related to alcohol, cannabis 
anxiety and depression. 

Secondary aims include examining the effects of the 
interventions on alcohol use related harms, self-efficacy to 
resist peer pressure, general disability, and truancy. The 
link between personality and substance use, as well as 
mental health will also be examined. 

Method/design 

In 2012 the CSC project was funded as part of a National 
competitive funding round. Ethical approval has been 
granted from the UNSW Human Research Ethics Com- 
mittee (HC13073) and from each school. 

Study design 

To establish the effectiveness of the integrated CSC inter- 
vention, a cluster RCT will be conducted in 84 Australian 
secondary schools between 2014 and 2016. Cluster ran- 
domisation will be employed to avoid contamination of 
the control group with the intervention group through 
student communication. Participating schools will be ran- 
domly allocated to one of four groups; (1) the CLIMATE 
Schools - Combined condition (CSC), (2) the CLIMATE 
Schools - Substance Use condition (CS-SU), (3) the CLIMATE 
Schools - Mental Health condition (CS-MH), or (4) the 



Control condition (CO). See Table 1 for a graphical display 
of the experimental design. 

Sample size calculations 

To account for cluster randomisation, sample size calcu- 
lations were based on recent sample size requirements 
developed by Heo & Leon [49]. to detect intervention by 
time interactions in longitudinal cluster randomised 
clinical trials. The CSC trial will be powered to detect 
differences in the overall sample as well as between sam- 
ples from each of four groups within the three States of 
NSW, QLD and WA. To allow for comparisons within 
each State, six schools (with at least 100 students) in 
each of the four intervention groups are required per 
state, giving a total of 24 schools per State (at least 2400 
students). This achieves 80 per cent power to detect a 
standardized between-group mean difference of 0.15 
(p = 0.05) in outcomes at the end of the trial with seven 
measurement occasions. An effect size of 0.15 is com- 
parable to previous school-based trials of universal 
mental health and substance use prevention programs 
and would have substantial benefits on a population level 
based on recent economic modelling [50]. To account for 
school dropouts during the trial, which we expect to be 
approximately 10 per cent, we aim to recruit at least 28 
schools in each State (at least 2800 students). This will re- 
sult in an overall sample of 8400 students from 84 schools 
at baseline to test the efficacy of the CSC intervention 
in comparison to the other groups. Based on previous 
research using the CLIMATE Schools programs, school 
participation rates for similar trials were approximately 
30 per cent [48,51]. Therefore, to recruit a total of 84 
schools, approximately 270 schools will be approached 
to participate. 

Procedure 

Recruitment of scliools and randomisation 

The recruitment, inclusion, and randomisation of the 
participants (schools and students) will commence in 
September 2013. A total of 270 schools will be selected 
from a list of all public, independent and catholic 
schools in NSW, QLD and WA. The Principals of these 
schools will be sent a letter outlining the aims of the 
research, school requirements, time-frames, details of 



Table 1 Experimental design 







Substance use 






+ 




Mental health 


+ 


•cs-c 


»CS-MH 






*cs-su 


»C0 



Key: 

*C0 = Control condition. 

*CS-MH = Climate Schools Mental Health condition. 
*CS-SU = Climate Schools Substance Use condition. 
*CS-C = Climate Schools Combined condition. 
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the randomisation procedure and an invitation for their 
school to participate. School Principals will then be 
followed up with a further email and phone call to invite 
their school to participate and explain the study re- 
quirements. Following school consent, randomisation 
will occur using the Ralloc function in Stata, and 
schools will be allocated to one of the four intervention 
groups shown in Figure 1. 

Information and consent forms will be sent home to 
parents/guardians of all Year 8 students (Year 9 for QLD) 
aged between 13-14 years, at participating schools. Only 
students who receive parental consent and give consent 
themselves will be eligible to be involved in the study. 

Interventions 

Following the baseline assessment, students in the CS-SU 
group will receive the CLIMATE Schools - Substance Use 
program during Year 8 (Year 9 in QLD), while aged 13- 

14 years old. Those students allocated to the CS-MH 
group will receive the CLIMATE Schools - Mental Health 
program during Year 9 (Year 10 in QLD), when aged 14- 

15 years old. Students in the CSC group will receive both 
the CLIMATE Schools - Substance Use and CLIMATE 
Schools - Mental Health programs over Year 8 and 9 (Year 
9 and 10 in QLD). 

Control group 

Students randomised to the Control group will receive 
their usual Health and Physical Education classes (includ- 
ing lessons on drugs, alcohol, and mental health) over the 
three years of the intervention period. Control schools will 
be asked to record any substance use and/or mental health 
education they deliver during the year, including how 
many lessons and the format of such lessons. Control 
schools will be offered the use of the CSC program follow- 
ing completion of the study. See Figure 1 for intervention 
breakdown by group. 



Assessnnent occasions 

Regardless of the condition to which schools are assigned, 
all students will be assessed via a self-report questionnaire 
at; baseline, immediately pre and post each CLIMATE 
Schools program (i.e.. Substance Use and Mental Health 
programs) and 18, 24 and 30 months after baseline. 
Schools will have the option to complete the assessments 
either online or by paper and pencil. Each student will be 
assigned a unique username and password to login to 
the study website and all survey data obtained is strictly 
confidential. Table 2 displays the anticipated CSC study 
assessment times. 

Measures 

Demographic data including gender, age, country of birth, 
academic performance, and truancy rates will be obtained 
to determine baseline equivalence of the groups. 

Alcohol and other substance use 

Students will be asked to rate the frequency and quantity of 
their alcohol consumption in standard drinks, frequency 
of drinking to excess (defined as having more than five 
standard drinks on a single occasion), age of first alco- 
hol consumption for both a sip, full drink and drinking 
to excess, the maximum number of standard drinks 
they have consumed on one occasion, the proportion of 
their friends who drink and their intention to try alco- 
hol. These questions were originally adapted from the 
School Health and Alcohol Harm Reduction Project 
(SHAHRP) 'Patterns of Alcohol' index [52] and trials of 
the 'Preventure' program [53], and reflect those used in 
previous CLIMATE Schools trials [47,48,51,54]. Other 
drug use will be measured by questions based on the 
2010 National Drug Strategy Household Survey (NDSHS) 
[45] and the 2011 Australian Secondary Students Alcohol 
and Drug Survey (ASSAD) [55]. This allows for compari- 
son between use in the current sample and a large scale 



Schools approached 

270 schools 



Schools recruited 

84 schools 
8400 students 



Allocated to Climate Schools 
Combined condition 
(CS-C) 

21 schools 
2100 students 



Allocated to Climate Schools 
Substance Use condition 
(CS-SU) 

21 schools 
2100 students 



Allocated to Climate Schools 
lUlental Health condition 
(CS-MH) 

21 schools 
2100 students 



Allocated to Control 
condition 
(CO) 

21 schools 
21 00 students 



Climate Schools- 
Combined program 



Climate Schools- 
Substance Use program 



Climate Schools- 
Mental Health program 



Drug education as usual during 
school hours 



Figure 1 Flow chart of anticipated overall allocation of schools to the intervention groups. 
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Table 2 Climate Schools Combined (CSC) study timeline 




Survey 1 


Climate Schools- 
Substance Use 
(module 1) 


Climate Schools - 
Substance Use 
(module 2) 


Survey 2 


Survey 3 


Climate Schools- 
Mental Health 


Survey 4 


Survey 5 


Survey 6 


Survey 7 


Time 


Term 1 


Term 1 


Term 3 


Term 3 


Term 1 


Term 1 


Term 1 


Term 3 


Term 1 


Term 3 




2014 


2014 


2014 


2014 


2015 


2015 


2015 


2015 


2016 


2016 


CS-C* 


/ 


X 


X 


/ 


/ 


❖ 


/ 


/ 






CS-SU* 


/ 


X 


X 


✓ 


✓ 




✓ 


✓ 


✓ 


✓ 


CS-MH* 


✓ 






✓ 


✓ 


❖ 


✓ 


✓ 


✓ 


✓ 


CO* 


✓ 






✓ 


✓ 




✓ 


✓ 


✓ 





Key: 

*CS-C = Climate Schools Combined group. 

*CS-SU = Climate Schools - Substance Use intervention only group. 
*CS-MH = Climate Schools - Mental Health intervention only group. 
*C0 = Control group. 
y = Measurement occasion. 

X = Climate Schools - Substance Use 12 lesson intervention. 
❖ = Climate Schools - Mental Health 6 lesson intervention. 
Survey time points: 
Survey 1: Baseline. 

Survey 2: Post-Substance Use intervention. 
Survey 3: Pre-Mental Health intervention. 
Survey 4: Post-Mental Health intervention. 
Survey 5: 6-month follow-up. 
Survey 6: 12-month follow-up. 
Survey 7: 18-month follow-up. 



representative group of Australians. Students will also be 
asked to rate on a five-point Likert scale, ranging from 
'very likely' to 'very unlikely', how likely it is that they will 
try alcohol, cannabis and any other drugs in the future. 

Other substance use measures 

Alcohol related harms will be assessed using the 23-item 
Rutgers Alcohol Problem Index (RAPI) [56]. Students 
will be asked to rate how many times in the past six 
months they have experienced harms such as, "neglected 
my responsibilities", as a consequence of drinking alcohol, 
on a five point Likert scale ranging from 'never' to 'more 
than 6 times'. Alcohol related knowledge will be assessed 
using a 16-item questionnaire originally adapted from the 
SHAHRP 'Knowledge of Alcohol' index [52], and reflect 
those used in previous trials using the CLIMATE Schools 
programs [47,48,51,54]. Participants' knowledge about 
cannabis will be assessed by the 16-item 'Knowledge 
about Cannabis' scale used in previous CLIMATE Schools 
trials [47,48,51,54]. 

Mental health measures 

The 'Kessler 6' scale (K6) [57] will be used to assess 
psychological distress in the past month. Two ques- 
tions from the 'Kessler 6 plus' (K6-I-) scale will also be 
included to assess the impact of distress on students' 
lives. Depression symptoms will be measured using the 
'Patient Health Questionnaire 8' (PHQ8) [58], while 
anxiety symptoms will be measured by the 'Generalised 
Anxiety Disorder 7-item scale' (GAD-7) [59]. The 3- 
item 'Mini Social Phobia Inventory' will screen for 



social phobia [60]. Quality of life will be measured by 
the 'Child Health Utility 9D' (CHU 9D) [61,62]. The 
25-item 'Strengths and Difficulties Questionnaire' 
(SDQ) [63] will be used to assess both positive and 
negative attributes of the students. Participants' know- 
ledge about coping with anxiety and depression will be 
assessed by twelve questions that cover appraisal, real- 
ity focused coping and emotion focused coping. 

Personality type 

The 23-item 'Substance Use Risk Profile Scale' (SURPS) 
[64] will be used to assess for variation in personality 
risk for substance abuse/dependence along four dimen- 
sions: sensation seeking, impulsivity, anxiety sensitivity 
and hopelessness. 

Peer pressure 

The 10-item 'Resistive Self-Regulatory Efficacy Scale' 
[65,66] will be used to measure participants' perceived 
efficacy to resist peer pressure to engage in high risk 
activities. 

Program evaluation and teacher log books 

Upon completion of the CLIMATE Schools programs, 
students and teachers will be asked to evaluate the pro- 
gram. Students will be asked to indicate how acceptable, 
appropriate and enjoyable they found the program and 
to indicate how likely it is they will use the information 
in their own lives. Teachers will be asked to rate the pro- 
gram; a) overall, b) in comparison to other substance use 
education programs, and c) in relation to the educational 
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quality of the program. Teachers will also be asked to indi- 
cate how easy the program was to implement, how well it 
held students' attention, and how likely it is that they 
would use the program in the future. 

Implementation and treatment fidelity 

All teachers delivering the CLIMATE Schools programs 
will be asked to complete a logbook, indicating which 
lessons and activities they completed with their class 
and to write down any adaptations they made to the 
program. To ensure completion and fidelity of the online 
part of the program, students are required to view the 
lessons in full and in order. Students are not able to access 
the next lesson until they have completed the previous 
online lesson in full. 

Record of additional substance use and mental health 
education 

Health and Physical Education teachers across all of the 
four study groups will be asked to record any substance 
use and/or mental health education that was delivered 
to students and/or their parents that was in addition to 
the CLIMATE Schools programs. Specifically teachers will 
be asked about the length, content and delivery method of 
this education. 

Statistical analysis 

Single-level analyses; one-way analyses of variance (for 
normally distributed data), Chi-square (for binominal 
data), and Mann-Whitney U-test (for non-normally dis- 
tributed data) will be used to examine baseline equivalence 
and attrition between groups. Due to the multi-level and 
hierarchical nature of the data, mixed effects regression 
will be used to examine intervention by time interaction 
effects. To account for intracluster variance within States 
or schools, intervention effects will primarily be examined 
using hierarchical linear modelling (HLM) for normally 
distributed data and hierarchical generalized linear model- 
ling using a Poisson distribution for count data. Outcome 
variables will be centred at post-test to allow for compari- 
sons between groups immediately after the intervention, 
and growth terms will be analysed to determine the mag- 
nitude of the follow-up effects. Analyses will be conducted 
using the program Stata. If unconditional models reveal 
that less than 10% of systematic variance exists at the be- 
tween State or between school level for any outcome vari- 
able, HLM will be abandoned and single-level analyses 
will be used [67]. For these variables, ANCOVAs utilising 
the SPSS GLM procedure will be conducted to account 
for any baseline differences that might exist between 
groups. For multiple comparisons Bonferroni adjustments 
will be made. Effect sizes, odds ratios and 95% confidence 
intervals will also be calculated. 



Discussion 

The present study protocol presents the design of a cluster 
RCT to evaluate the effectiveness of the CSC intervention; 
an integrated universal program to prevent alcohol and 
cannabis use and symptoms of anxiety and depression 
among adolescents. The primary aims of the CSC study 
are to evaluate the effectiveness of the CSC intervention 
compared to universal prevention programs for substance 
use and anxiety/depression when delivered alone and 
compared to school-based Health and Physical Education 
as usual in relation to; a) reducing the uptake and harmful 
use of alcohol and other drugs, b) reducing rates of anxiety 
and depression, and c) increasing mental health and sub- 
stance use related knowledge. 

Strengths and limitations 

The preventative focus of the CSC study on comorbid 
substance use and mental health symptoms in young 
people is a key strength of the study. To date, school pre- 
vention programs for anxiety, depression and substance 
use have mostly been designed to target one disorder at a 
time, rather than targeting all these common disorders. 
The development and evaluation of a combined preven- 
tion approach to mental health and substance use prob- 
lems is a critical step in acknowledging the comorbidity 
of these problems, including common antecedents, as 
well as influencing policy to improve mental health and 
wellbeing. 

The CSC intervention has been designed to overcome 
many obstacles and limitations of current school-based 
preventative programs. First, the program has been specif- 
ically designed to link with the curriculum, and is thereby 
potentially practical, acceptable, and scalable to all schools 
in Australia. Furthermore, implementation issues that 
have hindered previous school-based programs have 
been addressed through the use of innovative online de- 
livery methods, which are designed to increase program 
fidelity and increase student engagement. 

Finally, the study has been powered to allow for compar- 
isons between all four of the intervention conditions, both 
nationally and within each of the three States for effect 
sizes as low as .15. Such a large sample will allow for the 
detection of even small differences between groups. This 
will enable the investigators to establish the efficacy of the 
combined program over and above the stand-alone pro- 
grams, as well as normative substance use and mental 
health education in Physical Health and Education classes 
as usual. 

One limitation of the study is the inclusion of partici- 
pant self-report measurement for the primary outcomes 
of substance use and mental health symptoms. The use 
of self-report measures introduces the possibility of over 
or under reporting by participants. However, self-report 
measures have demonstrated excellent discriminant [68] 
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and predictive [69] validity in relation to substance related 
symptoms [53]. Self-report remains the most practical and 
popular method of assessment of substance use and men- 
tal health in young people within school settings. There 
are also currently no other feasible alternatives for data 
collection on substance use and mental health in these set- 
tings, as biological or observational measures would not 
be appropriate for such a large sample in the early stages 
of substance use initiation and mental health symptoms 
[70]. In order to maximise the accuracy of students' self- 
report data, the investigators will employ the following 
strategies: visual prompts in the form of standard drink 
charts, blind administration of any paper and pencil as- 
sessments within schools, and a strong emphasis on ano- 
nymity and confidentiality, with a special emphasis placed 
in the fact that schools and parents will not be given 
access to individual participants' data. 

Conclusion 

Research has highlighted the comorbidity of anxiety, de- 
pressive and substance use disorders, yet there are no 
existing prevention programs which adopt a combined 
approach to prevent and reduce symptoms associated with 
these common disorders. Furthermore, while a number of 
preventative programs for substance use and mental 
health symptoms are available, many yield minimal effect 
sizes, are not universally feasible and do not embody 
effective implementation strategies. The CSC study will 
be the first trial, internationally, to test a combined pre- 
vention model, whilst addressing the aforementioned 
limitations identified in current preventive programs. 

The CSC intervention has the potential to reduce sub- 
stance use, as well as reduce rates of anxiety and depres- 
sion at higher levels than either; a) separate substance 
use and mental health programs and, b) traditional class- 
room Health and Physical Education. Importantly, this 
study offers the potential for a paradigm shift, such that 
future preventive programs and research adopts a com- 
bined approach into understanding comorbid substance 
use and mental health disorders. 

Ethics approval number 

Ethics approval has been granted by the UNSW Human 
Research Ethics Committee (HC13073). 

Endnote 

^National Health and Medical Research Council of 
Australia (NHMRC) Targeted Mental Health Grant. 

Competing interests 

MT, NN and GA are three of the developers on the CLIMATE Schools program 
in Australia. These programs are distributed not for profit. The other authors 
declare that they have no competing interests. 



Autliors' contributions 

IVIT, NN, GA, TS and CC are the Chief Investigators on the CSC study NHIVIRC 
grant in Australia. LBirrell, ZT, NN and MT are responsible for ethics and 
clinical trial submission, recruitment of schools, and data collection. SA and 
NM are responsible for trail co-ordination, school recruitment and data 
collection in Western Australia. LH is responsible for trail co-ordination, 
school recruitment and data collection in Queensland. GA, LM and 
LBrownhill are responsible to modification of the CLIMATE Schools - Mental 
Health module. All authors were involved in study design and will be 
involved in data analysis and reporting of the study results. All authors read 
and approved the final manuscript. 

Acl<nowledgements 

This study is funded by the National Health and Medical Research Council 
(APPl 047291). Leanne Hides is supported by an Australian Research Council 
Future Fellowship. We would like to acknowledge Associate Investigators on 
the grant as well as the schools, teachers and students who have agreed to 
participate in this research. 

Author details 

^ NHMRC Centre for Research Excellence in Mental Health and Substance 
Use, National Drug and Alcohol Research Centre, University of New South 
Wales, 22-32 King Street, Randwick NSW 2052 Australia. ^National Drug 
Research Institute, Curtin University, Perth, Australia. ^Queensland University 
of Technology, Brisbane, Australia. ''Clinical Research Unit for Anxiety and 
Depression, St Vincent's Hospital, University of New South Wales, Sydney, 
Australia. 

Received: 30 September 2013 Accepted: 28 January 2014 
Published: 5 February 2014 

References 

1. Begg S, Vos T, Barker B, Stevenson C, Stanley L, Lopez A: The burden of 
disease and Injury In Australia 2003, in PHE 82. Canberra: AIHW; 2007. 

2. Teesson M, Degenhardt L, Hall W, Lynskey M, Toumbourou J, Patton G: In 
Substance use and mental health In longitudinal perspective, In Preventing 
harmful substance use: The evidence base for policy and practice. Fdited by 
Stockwal T Chichester: John Wiley and Sons; 2005:43-51. 

3. Spooner C: Public policy and the prevention of substance-use disorders. 
Curr Opin Psychiatry 2002, 15{3):235-239. 

4. Botvin GJ: Preventing drug abuse in schools: Social and competence 
enhancement approaches targeting individual-level etiologic factors. 
Addict Behav 2000, 25(6):887-897. 

5. WHO: Prevention of mental disorders: effective interventions and policy options. 
Geneva: Department of Mental Health and Substance Use; 2004. 

6. Lloyd C, Joyce R, Hurry J, Ashton M: The effectiveness of primary school 
drug education. Drugs Educ Prev Pol 2000, 7(2);109-126. 

7. Cuijpers P: Effective ingredients of school-based drug prevention 
programs: A systematic review. Addict Bei^av 2002, 27(6):1009-1023. 

8. Faggiano F, Vigna-Taglianti FD, Versino E, Zambon A, Borraccino A, Lemma P; 
School-based prevention for illicit drugs use: A systematic review. Prev Med 
2008, 46(5):385-396. 

9. Hansen WB: School-based substance abuse prevention: A review of the state 
of the art: in curriculum, 1980-1990. Health Educ Res 1992 7(3):403-430. 

10. Tobler NS, Stratton HH: Effectiveness of school-based drug prevention 
programs: A meta-analysis of the research. J Prim Prev 1997, 18(1):71-128. 

1 1 . Tait RJ, Christensen H: Internet-based interventions for young people 
with problematic substance use: a systematic review. Med J Aust 201 0, 
192(11 Suppl):S15-S21. 

12. Gorman DM: Do school-based social skills training programs prevent 
alcohol use among young people? Addict Res 1995, 4(2):191-210. 

1 3. White D, Pitts M: Review: Educating young people about drugs: A 
systematic rev\ew. Addiction 1998 93(10):1475-1487. 

14. Ennett ST Rosenbaum DP, Flewelling RL, Bieler GS, Ringwalt CU Bailey SL 
Long-term evaluation of drug abuse resistance education. Addict Behav 
1994, 19(2):1 13-125. 

15. Werch CE Moore MM, Diclemente CC, Owen DM, Carlson JM, Jobli E 
Single vs. multiple drug prevention: is more always better? A pilot study. 
Substance Use Misuse 2005, 40:1 085-1 1 01 . 

16. Munro G, Midford R: 'Zero tolerance' and drug education in Australian 
schools. Drug Alcohol Rev 2001, 20:105-109. 



Teesson ef al. BMC Psychiatry 2014, 14:32 
http://www.biomedcentral.com/1471-244X/14/32 



17. Beck J: 100 years of "just say no" versus "just say know": Re-evaluating 
drug education goals for the coming century. Evaluation Rev 1998, 
22(1 ):1 5-45. 

18. Botvin GJ: Advancing prevention science and practice: challenges, critical 
issues, and furture directions. Prev Sci 2004, 5(1):69-72. 

19. Ennett ST, Ringwalt CL, Thorne J, Rohrbach LA, Vincus A, Simons-Rudolph A, 
Jones S: A comparison of current practice in school based substance use 
programs with meta-analysis findings. Prev Sci 2003, 4(1):1-14. 

20. Boswoith K: Application of computer technology to drug abuse 
prevention. In tiandbook of Drug Abuse Prevention: Theory, Science and 
Practice Edited by Sloboda Z, Bukoski WJ. New York: Kluwer Academic/ 
Plenum Publishers: 2003:529-648. 

21. Greenberg M: Current and future challenges in school-based prevention: 
the researcher perspective. Prev Sci 2004, 5(1 ):5-l 3. 

22. Kaftarian S, Robertson E, Compton W, Davis B, Volkow N: Blending 
prevention research and practice in schools: critical issues and 
suggestions. Prev Sci 2004 5{l):l-3. 

23. Pentz MA: Form follows function: designs for prevention effectiveness 
and diffusion research. Prei/ 5c/ 2004, 5(l):23-29. 

24. Castro EG, Barrera M Jr, Martinez CR Jr: The cultural adaptation of 
prevention interventions: resolving tensions between fidelity and fit. 
Prev Sci 2004, 5(1)41-45. 

25. Elliott DS, Mihalic S: Issues in disseminating and replicating effective 
prevention programs. Prev Sci 2004, 5(l):47-53. 

26. Dusenbury L, Hansen WB: Pursuing the course from research to practice. 
Prev Sd 2004, 5(1 ):55-59. 

27. Botvin GJ, Griffin KW: Drug abuse prevention curricula in schools. In 

1- iandbool( of Drug Abuse Prevention: Tlieory, Science and Practice. Edited by 
Sloboda Z, Bukoski WJ. New York: Kluwer Academic/ Plenum Publishers: 
2003:45-74. 

28. Wenter DL, Ennett ST, Ribisl KM, Vincus AA Rohrbach L, Ringwalt CL, Jones SM: 
Comprehensiveness of substance use prevention programs in U.S. middle 
schools. J Adolesc Health 2002 30(6):455-462. 

29. Ringwalt C, Ennett S, Vincus A, Rohrbach LA, Simons-Rudolph A: Who's calling 
the shots? Decision-makers and the adoption of effective school-based 
substance use prevention curricula. J Drug Hue 2004, 34(1):19-31. 

30. Eaggiano F, Vigna-Taglianti ED, Versino E, Zambon A, Borraccino A, Lemma P: 
School-based prevention for illicit drugs' use. Cochrane Database Syst Rev 
2005, 18{2):1-101. 

31. Botvin GJ, Griffin KW: School-based programmes to prevent alcohol, 
tobacco and other drug use. int Rev Psychiatry 2007, 19(6):607-615. 

32. Cuijpers P: Three decades of drug prevention research. Drugs Educ Prev 
Poi 2003, 10(1):6-20. 

33. Morgenstern M, Wiborg G, Isensee B, Hanewinkel R: School-based alcohol 
education: results of a cluster-randomized controlled trial. Addiction 2009, 
104:402-412. 

34. Eoxcroft DR, Tsertsvadze A: Universal school-based prevention programs 
for alcohol misuse in young people (Review). In Cochrane Database of 
Systematic reviews 20i /. Online Publication: John Wiley & Sons, Ltd.: 201 1 . 
Issue 5. Art. No.: CD009113. 

35. Tobler NS, Roona MR, Ochshorn P, Marshall DG, Streke AV Stackpole KM: 
School-based adolescent drug prevention programs: 1998 meta-analysis. 
J Prim Prev 2000, 20(4):275-336. 

36. Cuijpers P, van Straten A, Smit E, Mihalopoulos C, Beekman A: Preventing 
the onset of depressive disorders: a meta-analytic review of 
psychological interventions. Am J Psychiatry 2008, 1 65(1 0):1 272-1 280 

37. Calear AU Christensen H: Systematic review of school-based prevention 
and early intervention programs for depression. J Adolesc 2010, 
33(3):429-438. 

38. Calear AU Christensen H: Review of internet-based prevention and 
treatment programs for anxiety and depression in children and 
adolescents. Med J Australia 2010, 192(1 1):S12-S14 

39. Dadds MR Holland DE, Laurens KR Mullins M, Barrett PM, Spence SH: Early 
intervention and prevention of anxiety disorders in children: results at 

2- year follow-up. J Consult Clin Psychol 1999, 67(1):145-150. 

40 Stallard P, Simpson N, Anderson S, Goddard M: The FRIENDS emotional 
health prevention programme - 12 month follow-up of a universal UK 
school based trial, fur Child Adolesc Psychiatry 2008, 1 7(5):283-289. 

41. Hunt C, Andrews G, Sakashita C, Crino R, Erskine A: Randomized controlled 
trial of an early intervention programme for adolescent anxiety 
disorders. Aust NZJ Psychiatry 2009, 43(4):300-304. 



Page 9 of 10 



42. Calear AL, Christensen H, Mackinnon A, Griffiths KM, O'Kearney R The 
youthmood project: a cluster randomized controlled trial of an online 
cognitive behavioral program with adolescents. J Consult Clin Psychol 
2009, 77(6):1 021 -1032 

43. Neil AU Christensen H: Australian school-based prevention and early 
intervention programs for anxiety and depression: a systematic review. 
Med J Australia 2007, 186(6):305-308. 

44. Champion KE, Newton NC, Barrett EU Teesson M: A systematic review of 
school-based alcohol and other drug prevention programs facilitated by 
computers of the Internet. Drug Alcohol Rev 2013, 32:1 15-123. 

45. AIHW: 2010 National Drug Strategy Household Survey report, in Drug statistics 
series no. 25. Cat. no. PHE 145. Canberra: AIHW: 201 1. 

46. Teesson M, Newton NC, Barrett E: Australian school-based prevention 
programs for alcohol and other drugs: A systematic review. Drug Alcohol 
Rev 2012 31(6):731-736. 

47. Newton NC, Teesson M, Vogl U Andrews G: Internet-based prevention for 
alcohol and cannabis use: final results of the Climate Schools course. 
Addiction 2010, 105:749-759. 

48. Newton NC, Andrews G, Teesson M, Vogl LE: Delivering prevention for 
alcohol and cannabis using the internet: A cluster randomised 
controlled trial. Prev Med 2009, 48:579-584. 

49. Heo M, Leon AC: Sample size requirements to detect an intervention 
by time interaction in longitudinal cluster randomized clinical trials. 
Stat Med 2009, 28:1017-1027. 

50. Nherera U Jacklin P: A model to assess the cost-effectiveness of alcohol 
education developed for NICE public health guidance on personal, social, 
health and economic (PSHE) education. London: National Collaborating 
Centre for Women's and Children's Health: 2009. 

51 . Vogl U Newton N, Teesson M, Swift W, Karageorge A, Deans C, McKetin R, 
Steadman B, Jones J, Dillon P, Havard A, Andrews G: Climate Schools: Drug 
prevention programs. Sydney: National Drug and Alcohol Research Centre, 
UNSW: 2009. 

52. McBride N, Earringdon F, Midford R Meuleners U Phillips M: Harm 
minimisation in school drug education: Final results of the School Health 
and Alcohol Harm Reducation Project (SHAHRP). Addiction 2004 99:278-291. 

53. Conrod P, Castellanos N, Mackie C: Personality-targeted intervention delay 
the growth of adolescent drinking and binge drinking. J Child Psychol 
Psychiatry 2008, 49(2):1 81 -1 90. 

54. Vogl U Teesson M, Andrews G, Bird K Steadman B, Dillon P: A computerised 
harm minimisation prevention program for alcohol misuse and related 
harms: Randomised controlled trial. /Idd/ct/on 2009, 104:564-575. 

55. White V, Bariola E: Australian secondary school students' use of tobacco, alcohol, 
and over-thecounter and illicit substances in 201 1. Canberra: Drug Strategy 
Branch, Australian Government Department of Health and Ageing: 2012. 

56. White HR, Labouvie EW: Towards the assessment of adolescent problem 
drinking. J Stud Alcohol 1 989, 50:30-37. 

57. Kessler RC, Andrews G, Coipe LJ, Hiripi t, Mroczek DK Normand SU Walters EU 
Zaslavsky AM: Short screening scales to monitor population prevalences and 
trends in non-specific psychological distress. Psychol Med 2002, 32(6):959-76. 

58. Johnson JG, Harris ES, Spitzer RU Williams JB: The patient health 
questionnaire for adolescents: validation of an instrument for the 
assessment of mental disorders among adolescent primary care 
patients. J Adolesc Health 2002, 30(3): 1 96-204. 

59. Spitzer RL, Kroenke K, Williams JB, Lowe B: A brief measure for 
assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 
2006, 166(10):1092-1097. 

60. Ranta K, Kaltiala-Heino R Rantanen P, Marttunen M: The IVlini-Social Phobia 
Inventory: psychometric properties in an adolescent general population 
sample. Compr Psychiatry 2012, 53(5):630-637. 

61 . Stevens K: Developing a descriptive system for a new preference-based 
measure of health-related quality of life for children. Qual Life Res 2009, 
18(8):1 105-1 113. 

62. Stevens KJ: Working with children to develop dimensions for a 
preference-based, generic, pediatric, health-related quality-of-life 
measure. Qual Health Res 2010, 20(3):340-351 . 

63. Goodman R, Meltzer H, Bailey V: The strengths and difficulties 
questionnaire: a pilot study on the validity of the self-report version. 
Eur Child Adoles Psy 1 998, 7:1 25-1 30. 

64. Woicik PA, Stewart SH, Pihl RO, Conrod PJ: The substance use risk profile 
scale: a scale measuring traits linked to reinforcement-specific substance 
use profiles. Addict Behav 2009, 34(12):1042-1055. 



Teesson ef al. BMC Psychiatry 2014, 14:32 
http://www.biomedcentral.com/1471-244X/14/32 



Page 10 of 10 



65. Bandura A: Guide For Constructing Self-Efficacy Scales, in Self-Efficacy 
Beliefs of Adolescents. In Self-Efficacy beliefs of Adolescents. Edited by Urdan T, 
Pajares F. Information Age Publishing; 2006:307-337. 

66. Bandura A, Caprara GV, Barbaranelli C, Gerbino M, Pastorelll C: Role of 
affective self-regulatory efficacy in diverse spheres of psychosocial 
functioning. Child Dev 2003, 74:769-782. 

67. Lee VE: Using hierarchical linear modelling to study social contexts: The 
case of school effects. Educ Psychol 2000, 35{2):125-141. 

68. Clark DB, Winters KM: IVleasuring risks and outcomes in substance use 
disorders prevention research. J Consult Clin Psychol 2002, 70:1207-1223. 

69. Crowley TJ, Mikulich SK, Ehlers KM, Whitmore AE, Macdonald MJ: Validity of 
structured clinical evaluations in adolescents with conduct and 
substance problems. J Am Acad Child Adolesc Psychiatry 2001, 40:256-273. 

70. Carrol KM: IVlethodological issues and problems in the assessment of 
substance use. Psychol Assessment 1995, 7(3):349-358. 

doi:10.1 186/1471-244X-14-32 

Cite this article as: Teesson et al: The CLIIVIATE schools combined study: 
a cluster randomised controlled trial of a universal Internet-based 
prevention program for youth substance misuse, depression and 
anxiety. fiMC Psychiatry 2014 14:32. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at \ ranu^\ 

www.biomedcentral.com/submit momea central 



